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Abstract. If x and y are roots in the root system with respect 
to the standard (Tits) geometric reahzation of a Coxeter group W, 
we say that x dominates y if for all w G VF, wy is a negative root 
whenever wx is a negative root. We call a positive root elementary 
if it does not dominate any positive root other than itself. The 
set of all elementary roots is denoted by S". It has been proved 
by B. Brink and R. B. Hewlett (Math. Ann. 296 (1993), 179-190) 
that is finite if (and only if) is a finite-rank Coxeter group. 
Amongst other things, this finiteness property enabled Brink and 
Hewlett to establish the automaticity of all finite-rank Coxeter 
groups. Later Brink has also given a complete description of the set 
(f for arbitrary finite-rank Coxeter groups (J. Algebra 206 (1998)). 
However the set of non-elementary positive roots has received little 
attention in the literature. In this paper we answer a collection of 
questions concerning the dominance behaviour between such non- 
elementary positive roots. In particular, we show that for any 
finite-rank Coxeter group and for any non-negative integer n, the 
set of roots each dominating precisely n other positive roots is 
finite. We give upper and lower bounds for the sizes of all such 
sets as well as an inductive algorithm for their computation. 



1. Summary of Background Material 

Definition 1.1. (Krammer [T3]) Suppose that ^ is a vector space over 
M and let ( , ) be a bilinear form on V, and let 11 be a subset of V. 
Then 11 is called a root basis if the following conditions are satisfied: 

(CI) (a, a) = 1 for all a G 11, and if a, b are distinct elements of 11 then 
either (a, 6) = — cos(7r/mafe) for some integer niab = rriha > 2, 
or else (a, 6) < — 1 (in which case we define niab = T^ba = oo); 
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{Papb) 



(C2) i PLC(n), where for any set A, PLC(A) denotes the set 
{ A^a I Aa > for all a G A and A^/ > for some a' G A }. 

aeA 

If n is a root basis, then we call the triple ^ = ( V, 11, ( , ) ) a Coxeter 
datum. Throughout this paper we fix a particular Coxeter datum 
Observe that (CI) implies that for each a G 11, a ^ PLC(n \ {a})- 
Furthermore, (CI) together with (C2) yield that whenever a, 6 G 11 
are distinct then {a, b} is linearly independent. For each a G 11 define 
Pa G GL(\^) by the rule: paX = x — 2{x, a)a, for all x G F. Note that pa 
is an involution and paa = —a. The following Proposition summarizes 
a few useful results: 

Proposition 1.2. [HI Lecture 1] (i) Suppose that a, 6 G 11 are dis- 
tinct such that rriab oo. Set 6 = Tc/rriab- Then for each integer 
h 

sin(22 + l)^ sin2ie, 

[papb) a = — a + . 6, 

sm u sm u 

and in particular, paPt has order rriab- 

(ii) Suppose that a, 6 G 11 are distinct such that rriab = oo. Set 
6 = cosh~^( — (a, 6)). Then for each integer i, 

+ if (a, 6)^-1 

{2i + l)a + 2ib, if(a,6) = -l, 

and in particular, paPb has infinite order. □ 

Let G^:^ be the subgroup of GL{V) generated by the involutions in 
the set { Pa I a G n }. Let {W, R) be a Coxeter system in the sense of 
[n] or [13] with R = {ra \ a E H} being a set of involutions generating 
W subject only to the condition (rar^,)'""'' = 1 for all distinct a, 6 G 11 
with ruab 7^ c>o. Then Proposition IL2I yields that there is a group 
homomorphism (pc^: W — )■ G'^ satisfying 4>^g-{ra) = Pa for all a G 11. 
This homomorphism together with the G<^-action on V give rise to 
a VT-action on V: for each w E W and x E V, define wx G by 
wx = 0<^(w)x. It can be easily checked that this IV-action preserves 
( , ). Denote the length function of W with respect to R by i. Then 
we have: 

Proposition 1.3. [TTl Lecture 1] Let G^^, W, R be as the above and let 
w eW andaeU. If i{wra) > i{w) then wa G PLC(n). □ 

Corollary 1.4. ( [ITl Lecture 1]) (p^^: W ^ G<^ is an isomorphism. 

Proof. All we need to show is that is injective. Let w E W such 
that wa = a for all a G 11. If w 7^ 1 then i{w) > 1, and so we can write 
w = w'va with a G n and i{w') = i{w) — 1. Since £{w'ra) > i{w') the 
above proposition yields that w'a G PLC(n); but then 

a = wa = w'vatt = w'(—a) = —w'a. 



DOMINANCE HIERARCHY IN COXETER ROOT SYSTEMS 



3 



implying = a + w'a G PLC(n), contradicting (C2) of the definition 



In particular, the above corollary yields that (G-ir, { Pa I « ^ n }) is 
a Coxeter system isomorphic to {W^R). We call iW^R) the abstract 
Coxeter system associated to the Coxeter datum ^ and we call W a 
Coxeter group of rank ^R, where # denotes cardinality. 

Definition 1.5. The root system of in is the set 



The set = $ fl PLC (11) is called the set of positive roots and the 
set $^ = — is called the set of negative roots. 

From Proposition 11.31 and Corollary 11.41 we may readily deduce that: 

Proposition 1.6. ([HI Lecture 3]) (i) Let w G W and a G 11. Then 

_ j i{w) - 1 if tya G 



Let T = [j^^yyiuRw"^, and we call it the set of reflections in W. 
For x G $, let px G GL(V^) be defined by the rule: Px{v) = v — 2{v,x)x, 
for all V & V. Since x G it follows that x = wa for some w ^ W and 
a G n. Direct calculations yield that = {4>'^{w)) pa{4>'^{w))^^ G G^^. 
Now let E W such that (p^^ir^) = Px- Then r^, = wr^w"^ G T 
and we call it the reflection corresponding to x. It is readily checked 
that Tx = T-x for all a; G $ and T = {ra;|a;G$}. For each t E T 
we let at be the unique positive root with the property that = t. 
It is also easily checked that there is a bijection T ^ given by 
t at (t G T), and x — j- 0<^^(pa;) (a^ £ *&^)- We call this bijection the 
canonical bijection between T and 

For each x G as in [3], we define the depth of a; relative to R to 
be dp(a;) = min{ i{w) \ w E W and wx G $~ }. For x,y E we say 
that X precedes y, written x -< y if and only if the following condition 
holds: there exists w E W such that y = wx and dp(j/) = i{w) +dp(x). 
It is readily seen that precedence is a partial order on , and the next 
result is taken from |3]: 

Lemma 1.7. ([3l Lemma 1.7 ]). Let r E R and a E \ {ctr}. Then 



of a root basis. 



□ 



^ = {wa \ w E W and a G 11 }. 




(ii) $ = [+) $ , where [+) denotes disjoint union. 

(iii) W is finite if and only if $ is finite. 



□ 




dp(Q;) — I if {a, a^) > 0, 
dp(a) if {a, ar) = 0, 
dp(a) + 1 if {a, ar) < 0. 



□ 
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Define functions N : W P(<l>+) and N : W ^ V{T) (where V 
denotes power set) by setting N{w) = {x E $^ | wx G $^ } and 
N{w) = { t G T I E{wt) < i{w) } for all w G W. Standard arguments 
as those used in [13j yield that for each w G W, i{w) = 4^N{w) and 
N{w) = {vrc \ X E N{w) }. In particular, N{ra) = {a} for each a G H. 
Furthermore, i{wv~^) + i{v) = i{w), for some w,v E W, if and only if 
N{v) C N{w). 

A subgroup W of is a reflection subgroup of W if W = {W fl T) 
(IV is generated by the refiections that it contains). For any refiection 
subgroup W of W, let 

S{w') = {teT\ N{t) nW = {t} } 

and 

A{W') = { X G I G S{W') }. 

It was shown by Dyer in [7] and Deodhar in [5] that {W, S{W')) forms 
a Coxeter system: 

Theorem 1.8. (Dyer) (i) Suppose that W is a refiection subgroup 
of W. Then {W , S{W')) forms a Coxeter system, and furthermore, 
W'nT = [j^^^,wS{W')w-\ 

(ii) Suppose that W is a refiection subgroup of 1^ and suppose that 
a,b E A{W') are distinct. Then 

(a, 6) G { - cos(7r/?2) | n G N and n > 2 } U (-oo, -1]. 

And conversely if A is a subset of satisfying the condition that 

(a, b) e {- cos(7r/ra) | n G N and n>2}U (-oo, -1] 

for all a, 6 G A with a b, then A = A(I1/') for some refiection 
subgroup W of W. In fact IV = ({ | a G A }). 

Proof, (i) [7, Theorem 3.3]. 
(ii) [7, Theorem 4.4]. 

□ 

Suppose that W is a refiection subgroup of W and suppose that 
( , )' is the restriction of ( , ) on the subspace of V spanned by A{W'). 
Then ^' = ( span(A(iy')). A(iy'). (, )') is a Coxeter datum with 
{W , S{W')) being the associated abstract Coxeter system. Conse- 
quently the notion of a root system applies to We let ^{W), 
^~^{W') and ^~{W') be, respectively, the set of roots, positive roots 
and negative roots for the datum Then it follows from Defini- 
tion O that <i>{w') = w'A{w'), $+(1^') = <i>(iy') n PLC(A(iy')) 

and ^-{W) = -^^{W). Note that Theorem O] (i) yields that 

^{W') = {x G $ I G ly' }. 

We call S{W') the set of canonical generators of W, and we call A(iy) 
the set of canonical roots of ^{W) (note that A{W') forms a root basis 
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for the Coxeter datum '^'). In this paper a reflection subgroup W is 
called a dihedral reflection subgroup if ^S{W') = 2. 

A subset $' of $ is called a root subsystem if VyX G $' whenever x, y 
are both in It is easily seen that there is a bijective correspondence 
between reflection subgroups W of W and root subsystems $' of $ 
given by t-)- <l>(iy) and $' t-). ({ | s G $' }). 

Theorem 11.81 (ii) yields that if a, 6 G $^ then {a, b} forms the set of 
canonical roots for the dihedral reflection subgroup {{ra, Vb}) generated 
by ra and if and only if (a, b) = — cos(7r/?T,) for some integer n > 2 
or else (a, 6) < —1. Observe that in either of these cases, {a,b} is 
linearly independent. In the former case a similar calculation as in 
Proposition 11.21 (i) yields that {rarb)"' acts trivially on V, furthermore, 
the dihedral reflection subgroup {{ra, rb}) is finite. In the latter case, 
let 9 = cosh~^(— (a, 6)), and for each integer i, we employ the following 
notation throughout this paper: 




if ^ 7^ 0; 
if 6 = 0. 



Then a similar calculation as in Proposition 11.21 (ii) yields that for each 
h 

{rar-bYa = Cai+iO + C2ib; 
nirarbYa = Cai+ia + 02^+2^; ^ 2) 

inraYb = C2ia + C2i+ib; 

TainraYb = C2i+2a + C2j+1&. 

It is well known (and can be easily deduced from (II. 2p ) that 

H{{ra, n})) = {cia + Ci±ib I 2 G Z }. (1.3) 

Since q > for all i > 0, it follows from (11. 2p and the fact that {a, 6} 
is linearly independent that rarb has infinite order, and consequently 
{{i^a)Tb}) is an infinite dihedral reflection subgroup of W. Observe 
that Ci 7^ Cj whenever i ^ hence (II. 2p yields that a and b are not 
conjugate to each other under the action of ({ra, r?,}), and consequently 
{{fai fb}) has two orbits on $(({ra, rb})), one containing a and the other 
containing b. The root CjO + Ci±ib lies in the former orbit if and only if 
i is odd, and it lies in the latter orbit if and only if i is even. 

For the rest of this section we assume that a, 6 G $^ with (a, b) < —1 
and we keep all the notation of the preceding paragraph. 

Proposition 1.9. Suppose that W is a reflection subgroup of the di- 
hedral reflection subgroup {{ra,rb})- Then ^S{W') < 2. 

Proof. Suppose for a contradiction that there are at least three canon- 
ical generators x, y and z for the subsystem Then from (II. 3p we 
know that there are three integers m, n and p with x = + Cm±ib, 
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X = Cma + Cm-lb 

y = Cna + Cn-ib 



then either (x, y) = cosh((m — n)9) > 1 (if 6* 7^ 0), or else (x, y) = I (if 
9 = 0), resulting in a contradiction to Theorem ll.8l (ii). Without loss of 
generality, we may assume that x = CmO. + Cm+ib and y = Cna + c„_i6. 
Now if z = Cpa + Cp+16, then a short calculation yields that either 
(x, z) = cosh((m — p)9) > 1 (if 6^ 7^ 0), or else (x, z) = 1 (if 6^ = 0), a 
contradiction to Theorem 11.81 (ii); on the other hand if z = Cpa + Cp-ib 
then, as before, either {z,y) = cosh((n — p)9) > 1 (if 6^ 7^ 0), or else 
{z, = 1 (if ^ = 0), again a contradiction to Theorem 11.81 (ii). □ 

We close this section with an explicit calculation of the canonical 
roots for an arbitrary dihedral reflection subgroup of ({ra,rb}). These 
technical results will be used in Section [31 Let 9 = cosh^^(— (a, 6)), as 
before. 

Suppose that x = Cmd + Cm+ib and y = Cna + Cn-ib are positive roots 
in $(({ra, Tfe})) (that is, m is a non-negative integer and n is a positive 
integer). Then either {x,y) = — cosh((m + n)9) < —1 (when 9 7^ 0), 
or else {x,y) = —1 (when 9 = 0), and it follows from Theorem 11.81 (ii) 
that {x,y} = A{{{r^,ry})). 

Suppose that x = + Cm+ib and y = Cna + c„+i6 are roots in 
^{{{ra,rh})) (with n < m G Z). Put d = m — n. Proposition 11.21 (ii) 
yields that 

^i.{{'^x,ry})) = {Ckd-mO' + Ckd-m-lb,Ckd+mO' + Ckd+m+lb \ k eZ}. (1.4) 

Let a, (3 be the canonical roots for this root subsystem. Then we claim 
that a = Citt + Ci-ib and (3 = cja + Cj+ib for some positive integer 
i and nonnegative integer j. Indeed, (11.31) yields that the only other 
possibilities are either 



and in either of these two cases, either (a,/3) = cosh((i — i)9) > 1, 
or else (a, /3) = 1, both contradicting Theorem 11.81 (ii). Therefore our 
claim holds, and in view of (11.41) we have 



for some integers ki and k2. In fact, ki and k2 satisfy the condition 
that ki{m — n) — m is the smallest positive integer of this form and 
k2{m — n) + m is the smallest non- negative integer of this form. 

Suppose that x = Cm+ia + Cmb and y = Cn+ia + c„6 are roots in 
<l>(({ra, Tf,})) (with n,m E Z). Put d = m — n. Interchanging the roles 




or 





(1.5) 
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of a and b in the preceding paragraph, we see that 
^{{{rx, ry})) = { cid+m+ia + Cid+mb, Cid-m-ia + Qd-mb \ k eZ}. (1.6) 

Let a', P' be the canonical roots for this root subsystem. Exactly 
the same reasoning as in the preceding paragraph yields that 



for some integers li and l2- Indeed li and I2 satisfy the conditions that 
/i(m — n) + m is the smallest non- negative integer of this form and 
him — n) — m is the smallest positive integer of this form. 



For a Coxeter datum ^ = ( V, 11, (, ) ), since 11 may be linearly 
dependent, the expression of a root in $ as a linear combination of 
elements of 11 may not be unique. Thus the concept of the coefficient 
of an element of 11 in any given root in $ is potentially ambiguous. 
This section gives a canonical way of expressing a root in $ as a linear 
combination of elements from 11. This canonical expression follows 
from a standard construction similar to the one considered in |12j . 

Given a Coxeter datum ^ = ( V, 11, ( , ) ), let be a vector space 
over M with basis n£; = {ea|aGn}in bijective correspondence with 
n and let ( , )e be the unique bilinear form on E satisfying 



Then '^e = {E, He, (, )_b) is a Coxeter datum. Moreover, '^e and 
^ are associated to the same abstract Coxeter system {W,R). Corol- 
lary [Ll] yields that : W — )■ G-i^^ = {{ \ a E H}) is an isomor- 
phism. Furthermore, W acts faithfully on on E via = Pe^y for all 
a G n and y E E. 

Let /: E V he the unique linear map satisfying /(e^) = a, for all 
a G n. It is readily checked that (/(x), f{y)) = (x, y)E, for all x,y G E. 
Now for all a G n and y & E, 



TaUm = PaUm = fiy) - '^ifiy), a)a = f{y) - 2{f{y), /(ej)/(ej 



Then it follows that wf{y) = f{wy), for all w & W and all y E E, 
since W is generated by { | a G 11 }. Let ^e denote the root system 
associated to the datum '^e, and let $^ (respectively, $^) denote the 
corresponding set of positive roots (respectively, negative roots). Then 
a similar reasoning as that of Proposition 2.9 of [12] enables us to have: 

Proposition 2.1. The restriction of f defines a W -equivariant bijec- 
tion ^E -> ^- 




(1.7) 



2. Canonical Coefficients 



Ca, Cf,) E = (a, b), for all a, 6 G 11. 



f{y-'2{y,ea)Eea) 

fiPeaV) 

f{ray)- 
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Proof. Since f{wea) = wa for aA\ w & W and a G 11, it follows that 
/($£;) = $. Proposition II. 61 applied to yields that, wCa G if and 
only if £{wra) = i{w) + 1, and this happens if and only if wa G so 
/($^) = We are done if we can show that the restriction of / on $^ 
is injective. Suppose that there are x,y E $^ with /(x) = f{y). Then 
'P'rf'P^lipx) = Pf(x) = Pf(y) = (j)'ff(p^lipy). Since 0.^ is an isomorphism, it 
follows that = (p'^liPy): that is, x and y correspond to the same 

reflection in W. Since x,y & it follows that x = y, as required. □ 

Since He is linearly independent, it follows that each root y E ^e 
can be written uniquely as ^^gn ^a^a', we say that Xa is the coefficient 
of Cq in y and it is denoted by coeffe^(?/). We use this fact together with 
the H^-equivariant bijection /: ^ $ to give a canonical expression 
of a root in $ in terms of 11: 

Definition 2.2. Suppose that x G $. For each a G 11, define the 
canonical coefficient of a in x, written coeffa(x) by requiring that 
coeffa(x) = coeffe^(/^^(x)). The support, written supp(x) is the set 
of a G n with coeffa(x) 0. 

3. The Dominance Hierarchy 

Definition 3.1. (i) For x and y G $, we say that x dominates y with 
respect to W if {w e W \ wx e ^~ } <^ {w e W \ wy e ^~ }. If x 
dominates y with respect to W then we write x >y. 
(ii) For each x G set D{x) = {y E $^ \ y ^ x and x >y}, and 
if a; G and D{x) =0 then x is called elementary. For each n G N, 
define D„ = { x G | #-D(x) = n }. 

Note that Do here is the same set as of [5] and [1]. In ^ and [1] 
dominance is only defined on and it is found in [5] that dominance 
is a partial order on Here we have generalized the notion of dom- 
inance to the whole of $, as was considered in, for example, [12] • It 
can be readily seen that this generalized dominance is a partial order 
on $. Observe that it is clear from the above definition that 

$+=1+1 D„. 

neN 

The set Dq has been properly investigated in [3j and [4J: if W is finite 
then Do = (that is, if W is finite, then there is no non-trivial dom- 
inance among its roots), whereas if W is an infinite Coxeter group of 
finite rank, then #-Do < oo and furthermore, we can explicitly compute 
Dq. Observe that in the latter case l+J„gi^„>i -D„ will be an infinite set. 
One major result of this paper (Theorem 13.81 below) is that if R is finite 
then Dn is finite for all natural numbers n. We also give upper and 
lower bounds on #Z)„ (Corollary 13.91 and Corollary 13.211 below). But 
first we need a few elementary results: 
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Lemma 3.2. (i) If x and y G then x>y if and only if (x, y) > 1 
and dp(x) > dp(y) (with equahty on depth if and only ii x = y). 

(ii) Dominance is l^-invariant: if x>y then wx > wy for any w & W. 

(iii) Suppose that x,y E ^, and x >y. Then — y > — x. 

(iv) Suppose that x G and y G Then a; > y if and only if 
{x,y) > 1. 

(v) Let x,y G $. Then there is dominance between x and y if and 
only if (x, y) > 1. 

Proof, (i) Essentially the same reasoning as in [31 Lemma 2.3] applies. 

(ii) Clear from the definition of dominance. 

(iii) Suppose for a contradiction that there exists w E W such that 
w{—y) G $~ and w{—x) G Then w(?/) G yet iy(x) G 
contradicting the assumption that x >y. 

(iv) Suppose that x > Since dominance is ly-invariant, it follows 
that TyX > Tyy G $^ and hence TyX G Now part (i) yields that 
{ryX.Tyy) > 1. Since ( , ) is IV-invariant, it follows that (x, y) > 1. 

Conversely, suppose that x G $^ and y G $~ with {x,y) > 1. Then 
clearly r^x = x — 2{x,y)y G Thus r^x and r^?/ = —y are both 
positive. Then it follows from part (i) that there is dominance between 
ryX and Vyy. Since dominance is IV- invariant, it follows that there is 
dominance between x and y. Finally, given that x G and y G $~, 
it is clear that x >y. 

(v) Suppose that x,y G Then part (i) yields that there is domi- 
nance between — x and —y ii and only if (— x, —y) = {x,y) > 1. This 
combined with part (i) and part (iv) above yields the desired result. 

□ 

The following is a simple result that we use repeatedly in this paper: 

Lemma 3.3. Let x, ?/ G $ be distinct with x >y and y E Dq. Then: 

(i) TyX G $+; 

(ii) (r^x, x) < —1 and {ryX,y) < —1, and in particular, TyX cannot 
dominate either x ory. 

Proof, (i) Suppose for a contradiction that r^x G Lemma [3.21 (ii) 
then yields that VyX > Tyy = —y. Now Lemma 13.21 (iii) yields that 
y > —TyX G Since y E Dq, this forces —VyX = y, contradicting 

x^y. 

(ii) Since x >y, it follows from Lemma [3.21 (v) that {x,y) > 1. Then 
{ryX,y) = (x, —y) < —1 and hence there is no dominance between VyX 
and y. Also (rj^x,x) = (x, x) — 2(x, y)^ < —1 and thus there is no 
dominance between x and VyX either. □ 

Suppose that x, ?/ G $ with x >y. It is worthwhile investigating the 
connection between this dominance and the canonical generators of the 
root subsystem ^{{{rx,ry})). 



10 



FU, XIANG 



Proposition 3.4. Suppose that x,?/ G $ are distinct with x >y. Let 
a,b be the canonical roots for the root subsystem ^{{{rx,ry})) . Then 
there exists w G {{rx,ry}) such that either 

wx = a , f wx = b 

, or else < 

wy = —b y wy = —a 

In particular, {a,b) = —{x,y). 

Proof. By Theorem 11.81 (ii) we know that 

(a, b) G (-00, -1] U { - cos(7r/n) | n G N and n>2}. 

Suppose for a contradiction that {a,b) = — cos{tt /n) for some integer 
n > 2. Write 6 = vr/n, and Proposition 11.21 (i) yields that 

^/,r T V N , sin(m + 1)6' sin m6', , , 

$(({ra, rJ)) = { ^ TT^a H —b m G N and < m < 2n}. 

sm sm 

Hence there are distinct integers mi and m2 (less than 2n) such that 

sinfmi + 1)6' sinmi^ sin(m2 + 1)^ sinm2^, 
X = — a H ^-^0 and y = — a H ^^b. 



But then {x,y) = cos{{mi—m2)Tc/n) < 1, contradicting Lemma [3l2] (v). 
Thus (a, b) < —1 and so Lemma [3.21 (v) yields that a>—b and b > —a. 
It then follows readily that there are two dominance chains in the root 
subsystem $(({ra, r;,})), namely: 

■ raThTaib) > r<jrfc(a) > ra{b) > a 

> -6 > rb(-a) > rfer,(-6) > ■■■ (3.1) 

and 

rbraTbia) > ri,ra{b) > r6(a) > b 

>-a>ra{-b)\>rarb{-a)\>---. (3.2) 

Observe that each element of $(({ra,rb})) lies in exactly one of the 
above chains, and the negative of any element of one of these chains 
lies in the other. Thus x', y' G ^(({ra, rf,})) are in the same chain if and 
only if {x',y') > 1 and in different chains if and only if {x',y') < —1. 

From (13. ip we see that the roots dominated by a are all negative, 
and from (13.21) we see that the roots dominated by b are all negative. 
Clearly we may choose w G {{ra,rb}) such that either wx = a or 
wx = b, and since wx > wy, it follows that either 

wx = a and G $(({ra, rf,})) fl $~ (3.3) 

or 

wx = b and wy G $(({ra, r;,})) fl (3.4) 

Suppose that wx = a. Then {a,—wy) = {wx,—wy) = —{x,y) < —1. 
Now since -wy G $(({r^, r^^})) H $+ and {{ra,r^^y}) = {{rx,ry}), it 
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follows from Theorem 11.81 (ii) that {a, —wy} is the set of canonical 
roots for $(({r3,, r^})), which then forces that —wy = b. Similarly, in 
the case wx = b, we may conclude that wy = —a. 

□ 

Lemma 3.5. Suppose that x, y E ^ are distinct with x>y. Let a and 
b be the canonical roots for ^{{{rj.,ry})) . Then either 

X = CmO' + Cm+lb ^ \ X = Cmd + Cm-lb 



or 

y = Crn-ia + CrrJj \ V = Cm-lO + Cm-2& 

for some integer m, where Ci is as defined in for each integer i. 



Proof. Proposition 13.41 yields that (a, 6) < —1. Since a, 6 are the 
canonical roots of $(({r^, Tj^})), it follows from equation (11.31) that 
X = Cmd + Cm±ib and y = Cna + Cn±ib, for some integers m and n. Let 
9 = cosh~^(— (a, b)). If either 

CjyjCi -|- Cm+ib \ X c^ci -|- Cfji—ib 

y = Cna + Cn-ib \ y = c^a + Cn+ib ' 

then either (x, y) = — cosh((?T, + m)9) < —1 (when 9 ^ 0), or else 
{x,y) = — 1 (when = 0), contradicting x > Therefore there are 
only two possibilities, namely: 

y = c„a + Cn+ib 
or 

y = c„a + Cn-ib. 

First suppose that (13.51) is the case. Since a and b are the canonical 
roots for $(({ra, rf,})) = $(({rj., r^})), it follows from equation (II. 5p 
that there are integers ki and k2 such that 

1 = ki{m — n) — m and = k2{m — n) + m. 

But then ki + k2 = G Z. Clearly this is only possible when 

m — n = ±1. On the other hand, since x >y, ii is readily seen that 
m > n, giving us x = Cmd + Cm+ib and y = Cm-ia + Cmb. On the 
other hand, if (13. 6p is the case, then by taking equation (ll.7p into 
consideration, a similar reasoning as above yields that x = Cm^ + Cm-ib 
and y = Cm-ia + Cm-ib- □ 

Remark 3.6. Let x and y be as in Proposition 13.41 and Lemma 13.51 
above. Then in fact x and y are consecutive terms in precisely one of 
the dominance chains (13.11) or (13.21) . 

Now we are ready for the first key result of this paper: 

Theorem 3.7. Di C {rab \ a,b G -Do}- Furthermore, if i^R < oo 
then #Di < (#Do)2-#Do. 
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Proof. Suppose that x E Di and let D{x) = {y}. Clearly y E Dq. By 
Lemma [3.31 (i), we know that TyX G Thus to prove Theorem 13.71 
it suffices to show that TyX G Dq. 

Suppose for a contradiction that TyX G \ Dq. Then there exists 
z G $^\{ryx} with TyX^z. Since dominance is ly-invariant, it follows 
that X > TyZ. If TyZ = y then z G contradicting our choice for z. 
Then the fact D{x) = {y} implies that VyZ G and in particular, 
{z, y) > 0. Since VyX > z and x>y, it follows from Lemma [3.21 (i) that 
{ryX,z) > 1 and {x,y) > 1. Then 

1 < {ryX, z) = {x- 2{x, y)y, z) 

= {x,z) - 2{x,y){y,z), 

implying that 1 < {x,z). Hence Lemma 13.21 (v) yields that either 
X > z or else z > x. In the latter case VyX > z > x, contradicting 
Lemma 13.31 (ii). On the other hand, if x > z, then our construction 
forces z = y. But then VyX > y, again contradicting Lemma 13.31 (ii). 
Thus TyX G -Do 5 as required. Since x G -Di was arbitrary, it follows that 
D,C{rab\a,beDo}. 

Finally, since Di does not contain elements of the form r^a, a E Dq, 
it follows that 

DiC{rab\a,beDo}\-Do. (3.7) 
In the case that #-R < oo. Theorem 2.8 of [3J yields that #-Do < oo, 
and so it follows from ^ that #Di < (#L'o)^ - #^o- □ 

The above treatment of Di can be generalized to D„ for arbitrary 
n G N. Indeed we have: 

Theorem 3.8. For n eN, 

Dn^{rab\ae Do,be l+| D„ }. 

m<n—l 

Proof. The case n = 1 has been covered by Theorem 13.71 so we may 
assume that n > 1. 

Let X G Dn, and suppose that D{x) = { 1/2, ...,?/„ }, with y„ 
being minimal with respect to dominance. Clearly ?/„ G Dq and so 
Lemma [3.31 (i) yields that Vy^x G Hence either Vy^^x G Dq or else 
Ty^x G $+ \ Z^o- 

If Vy^x G Dq, then 

xe{rab\a,bEDo}C{rab\aeDo,be [+) D^}, 

m<n—l 

and the desired result clearly follows, given the arbitrary choice of x. 

If Ty^x G \ il'o, let z G Divy^x). We claim that there are at 
most (n — 1) possible values for z. Observe that this claim implies the 
following: 

V ^ 1+) ^m, 

m<n— 1 
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then it follows immediately that D„ C { r^fe | a G Dq, b G \+jm<n-i }; 
since x G Dn was arbitrary. 

Thus all it remains to do is to prove the above claim. Since Vy^x > z, 
Lemma[221(ii) yields that x>ry^z. Thus either Vy^z G and in which 
case Vy^^z = yi, for 1 < z < n — 1; or else Vy^z G If Vy^z G $~ then 
clearly (y^, z) > 0. Since Vy^^x > z and x > Lemma 13.21 (v) yields 
that {ry^x,z) > 1 and {x,yn) > 1- Then 

1 < (ry^x, z) = {x- 2(x, yn)yn, z) 

= (x, z) - 2{x,yn)iyn,z), 

and hence it follows that {x,z) > 1. Similar to the proof of Theo- 
rem 13. 7[ we can conclude that x > z and so 2 G {yi, ■ ■ ■ ,yn}- Since 
x>z as well as Vy^x > z, Lemma 1X51 (ii) yields that z G {yi, ■ ■ ■ , yn-i}- 
Summing up, if 2; G D{ry^x), then 

ze{ry„{yi) I ry^iyi) G $+, i G { 1, . . . , n - 1 } } 

U{z/i I ry„{yi) G i G {l,...,n - 1}}, 

and this is clearly a disjoint union of size n — 1. Thus Vy^^x G -Dm, for 
some m < n — 1 and the claim is proved. 

□ 

Note that for each positive integer n, Theorem 13.81 immediately yields 
the following upper bound for the size of the corresponding D„. 

Corollary 3.9. Suppose that < 00. Then ij^Dn < 00 for alln G N. 
Indeed 

Proof. Clearly Di (iDj = ^ whenever i ^ j, so Theorem 13.81 yields that 
Dn ^ {rab \ a e Do,b e \Sm<n-i ^rn} \ (l±)m<n ^rn) and the desired 
result then follows from a simple induction on n. □ 

Having shown that for all n G N, 7^-D„ < 00 if j^R < 00, it is not 
immediately clear, at this stage, that for each n G N, the corresponding 
Dn 7^ 0. Lemma 13.101 to Corollary 13.211 below will, amongst other 
things, establish that Dn 7^ for each n G N if is an infinite Coxeter 
group of finite rank. 

Lemma 3.10. For n eN, 

{wa \ a e Dq, w eW, £{w) < n } n D„ = 0. 

Proof. Suppose for a contradiction that there exist some n E N and 
X = wa G Dn such that a E Dq and w E W with i{w) < n. Sup- 
pose that D{x) = {yi, . . . ,yn}- Since dominance is VT-invariant, it 
follows that a = w~^x dominates all of w~^yi, w~^y2, ■ ■ ■ , w~^yn- Note 
that a ^ {w~^yi, ■ ■ ■ ,w~^yn}- Since a is elementary, it follows that 
w^^yi, ■ ■ ■ , w~^yn E $~, that is, yi, - ■ ■ ,yn ^ N{w~^), but this contra- 
dicts the fact that #A^(w;-^) = ffw"^) = e{w) < n. □ 
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Lemma 3.11. 

RDo C -Do W L>o W Di. 

Proof. Suppose that r ^ R and x G Dq are arbitrary. If rx G 
then Lemma 13.101 above yields that rx G Dq l±l Di. On the other 
hand, if rx G then x G 11, which in turn imphes that r = r^ and 
rx = —X G —11 C —Do- □ 

Generahzing Lemma EHH we have: 
Lemma 3.12. For all n > 1, 

Proof. Suppose that n > 1, and let x G -D„, and 2; G 11 be arbitrary. 
Since x z, it follows that r^x G 

Suppose for a contradiction that r^a; G -Dm for some m > n + 2. Let 
/^(r^x) = {yi, . . . ,ym}. Then x > r^yi, ■ ■ ■ , r^ym- Since x G -D„, and 
m > n + 2, it follows that there are 1 < i < j < m with r^i/j G $^ 
and r^^/j G But this is impossible, since could only make one 
positive root negative. Therefore we may conclude that r^x ^ Dm 
where m > n + 2. A similar argument also shows that r^x ^ D.^' 
where m' < n — 2, and we are done. □ 

Lemma 3.13. Suppose that x, y are in with y ^ x. Let w & W 
be such that x = wy and dp{x) = dp{y) + i{w). Then y G Dm implies 
that X G Dn for some n > m. Furthermore, wD{y) C D{x). 

Proof. It is enough to show that the desired result holds in the case 
that w = ra for some a G 11. The more general proof then follows from 
an induction on i{w). 

Since x = ray and y -< x. Lemma 11.71 yields that (a, y) < and so 
Lemma [3]2] (v) yields that a ^ D{y)- Let D{y) = { zi, Z2, ■ ■ ■ , Zm}- 
Then the fact a G 11 implies raD{y) C Since dominance is W- 

invariant, it follows that x > r^Zj for all i G { 1, 2 . . . , m }. Therefore 
{ raZi,raZ2, ■ ■ ■ , raZm } ^ -D(x), whcuce X G Dn for some integer n > m, 
and raD{y) C D(x). □ 

The next proposition, somewhat an analogue to Lemma II. 7[ has 
many applications, among which, we can deduce, for arbitrary positive 
root X, the integer n for which x G -D„. Furthermore, it enables us to 
compute D{x) explicitly as well as to obtain an algorithm to compute 
all the -D„'s systematically. 

Proposition 3.14. Suppose that x G -D„ with n >1, and a G 11. Then 

(i) r^x G Dn-i if and only if (x, a) > 1; 

(ii) raX G Dn+i if and only if (x, a) < — 1; 

(iii) r^x G Dn if and only if (x, a) G (—1, 1). 



DOMINANCE HIERARCHY IN COXETER ROOT SYSTEMS 15 

Proof, (i): Suppose that x G -D„ and a G 11 such that G -Dn-i- 
Let D{x) = { Zi, Z2, . . . , Zn}- Since dominance is Vl^-invariant, it fol- 
lows that TaX > TaZi for all i G { 1, 2, . . . , n }. Thus at least one of 
r^zi, . . . ^TaZn must be negative. Without loss of generality, we may 
assume that TaZi G $~. Since a G 11, it follows that a = zi. Therefore 
X > a, and Lemma [3.21 (v) then yields that (x, a) > 1. 

Conversely, suppose that x G Dn and a G 11 such that (x, a) > 1. 
Then Lemma [3.21 (i) yields that x > a; furthermore. Lemma [LT] yields 
that TaX -< X. Hence Lemma [3.131 yields that 

TaDirax) C D{x). (3.8) 

Now suppose for a contradiction that r^x ^ -Dn-i- Then Lemma [3.121 
yields that r^x G -D„ W -Dn+i- From f l3.8p it is clear that r^x ^ -Dn+i- 
But if r^x G -Dn, then f l3.8p yields that TaDijax) = D{x). Observe that 
a E D{x) and a ^ TaDijax)^ producing a contradiction as desired. 

(ii) : Replace x by r^x in (i) above then we may obtain the desired 
result. 

(iii) : Follows from (i), (ii) and Lemma [3.121 

□ 

Definition 3.15. For each x G define 

S{x) = {w eW \ £{w) = dp{x) - 1 and G IT }, 

T(x) = {w eW \ i{w) = dp{x) and w'^x G }. 

In other words, for x G 5'(x) (respectively, T(x)) consists of all 
w G of minimal length with w~^x G II (respectively, w~^x G — H). 
Note that for each w G 5'(x), there exist some w' G T(x) and a G II 
such that w' = wva with i{w') = i{w) + 1. 

Proposition 3.16. Suppose that x G $^ and let w G 5'(x) be arbitrar- 
ily chosen. Then x G -D„ where n = b G N{w~^) | (x, 6) > 1 }. /n 
particular, the integer n is independent of the choice of w E S{x). 

Proof. Let x G $^ and write x = where w G S'(x) and a G II. Let 
w = Vaj^ ■ ■ -Tai be such that / = l{w) and ai, 02, ■ ■ ■ , a/ G II. Observe 
that for each i G { 2, . . . , / }, 

^ ('"ai'"a2 ' ' ' ^ai-2^^i—i ^o-i ' ' '^ai^ai ' ' ■'"ai_2'^j— 1 

— T^ai ' ' ' ai"^ ai-iO,i-l 

= -Tai- ■ ■ra.O'i-l- (3.9) 

Under our assumptions i{rairai_^ ■ ■ -raja^.^) = ^(r^, ■ ■ - raj + 1 and 
K^a^ra^ ■ ■ ■ rai_2ra,_i) = K^a^ra^ " " "'^a.-a) + 1, hcucc Propositiou [Ll(i) 
yields that r^, ■ ■ -ra.aj.i G and ra^ra2 ■ ■ -ra^.jaj.i G Thus ([S3]) 
yields that 

{ra,ra2 ■ ■■ra,_2K-i e N{w-^). (3.10) 
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Now by Proposition 13.141 we can immediately deduce that x G -D„ 
where 

n = #{ i I (ai_i , rara,+^ ■ ■ ■ Va^a) < -1 } 

= #{ ^ I (^ai ■ ■ ■ Ta,^, (Cli-l) , Ta,--- (o)) < "1 } 
= #{ ^ I (^ai ■ ■ ■ ra,^i (Oi-l) > X) < -1} 

= #{ « I (-'"ai ■ ■ ■ ra,_2 > a;) < -1 } 

= #{beN{w-') I < -1} 

= ^{beN{w-^) I > 1}. 

Lemma 1X21 (v) then yields that either x>b or b>x. Since all such b are 
in N{w~^) where w G S{x), it follows that w^-^x G 11 and w^^b G 
Thus b cannot dominate x. So we may conclude that x G -D„, where 

n = #{6G A^(u7~^) |2;>6}, (3.11) 

for all w G S'(x). But (13. lip says precisely that D{x) C N{w^^) and 

L)(x) = {be N{w-^) \x>b} 

= {be N{w-^) I {x,b) > 1}. 

□ 

From the above proof we immediately have: 
Corollary 3.17. Let X e Then D{x) C f] N{w-^). □ 

It turns out that we can also say something about the roots in 
f]wes{x) ■^i'^'^) \ D{x). Indeed in the next two lemmas we deduce 
that if b G n^e5(x) N{w~^), then (x, b) > 0. 

Lemma 3.18. Suppose that x G w G T{x) and b G N{w^^). Then 
{b,x) > 0. 

Proof. If dp(a;) = 1 then x G 11, whence T{x) = {r^} and x = b, and 
so {b,x) = 1 as required. Thus we may assume that dp(a;) > 1 and 
proceed by an induction on dp(x). Let a G 11 fl N^w"^). Then 

i{raw) = i{w-^ra) = e{w-'^) - 1 = i{w) - 1. 

Now since {raw)~^{rax) = w~^x G it follows that 

dp(rax) < i{raw) < i{w) = dp(x), 

and hence Lemma 11.71 yields that {a,x) > 0. If 6 = a then we are 
done, thus we may assume that 6 7^ a (in particular, r^fe G and 
let w' = TaW. Observe that then w' G T{rax). Since b G N{w~^), 
it follows that Tab G N{w'~^) and so the inductive hypothesis yields 
that {rab,rax) > 0. Finally since ( , ) is VT-invariant, it follows that 
(6, x) > as required. □ 
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Lemma 3.19. Suppose that x G w G S{x) and h G N{w^^). Then 
{b,x) > 0. 

Proof. Follows from Lemma [3.181 and the fact that for each w G S{x) 
there is a G T{x) such that N{w-^) C N{w'-'^). □ 

Lemma 3.20. For n eN, if Dn = 0, then D^n = for allm such 
that m > n. 

Proof. Suppose for a contradiction that there exists n G N such that 
Dn = and yet Dn+i 7^ 0. Let x G -Dn+i- Then Lemma [3.121 yields 
that TaX G Dn+i^Dn^2, ioT all a G n. Furthermore, Lemma 13 . 1 3 1 yields 
that if a G n such that VaX -< x then raX G D^+i still. Write x = wb, 
where 6 G 11, and w G S{x). Suppose that w = Ta^Va^- ■ - Tai with 
l{w) = I and Oi, 02, . . . , G 11. Then Tq- ■ ■ -rajra^x G -Dn+i, for all 
i G {1,...,/}, and in particular, 6 = ■ ■ ■ r^jX G -D„+i, contradicting 
the fact that 6 G 11 C L'o- □ 

Corollary 3.21. Let W be an infinite Coxeter group with < 00. 
Then for each nonnegative integer n, the corresponding Dn is non- 
empty. 

Proof. It is clear from the definition of the Z^n's that = l+J„>o Dn- 
Since W is an infinite Coxeter group. Proposition 11.61 (iii) yields that 
= 00, On the other hand, since #i? < 00, Theorem 13.81 yields 
that for each nonnegative integer n, #-D„ < 00. Thus the desired result 
follows from Lemma [3.20[ □ 

The following is a generalization of Proposition 13.141 

Proposition 3.22. Suppose that x G Dn with n > 0, and let a G 

Then 

(i) i^D{rax) < n if {x,a) > 1; 

(ii) i^D{rax) > n if {x,a) < -1. 

Proof, (i) If dp(a) = 1 then this is just Proposition 13. 141 Hence we 
may assume that dp (a) > 1, and proceed by an induction on dp (a). 

Write a = r^c where 6 G 11 and c G Then = rfyTcTh. Further- 
more, suppose that 

dp(a) = dp(c) + 1. (3.12) 

Now since {x,a) = {x,rf,c) = {rhX,c) > 1, it follows from the inductive 
hypothesis that 

#D(r,(r,a;)) < i^D{r,x). (3.13) 
Then we have three possibilities to consider: 

1) (6,x) > 1; 

2) (&,x)<-l; 

3) (6,x) G (-1,1). 
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If 1) is the case, then Proposition 13.141 yields that r^x G D„_i and 
hence 

#D{raX) = 4^D{rb{rcrbx)) 

< i^D{rc{rbx)) + 1 (follows from Lemma [3. 121 ) 

< i^D{nx) (follows from fl313D ) 
= n — 1, 

as required. 

If 2) is the case, then Proposition 13.141 yields that rfeX G -D„+i, and 
{h,rc{ri,x)) = {b,rbX — 2{rbX,c)c) = {b,rf,x) — 2{x,a){b,c). Observe 
that Lemma 11.71 and (13.121) together yield that (6, c) < and since by 
assumption (x, a) > 1, it follows that 

{b,r^{rbx)) > {b,rhx) >1. (3.14) 

Then 

#D{rax) = 4j^D{n{rcrbx)) 

= ij^Dirj-bx) — 1 (by (13.141) above and Proposition 13. 14p 
< i^D{nx) - 2 (by dSH) 

<n — 1 (since VbX G -Dn+i in case 2)) 

as required. 

If 3) is the case, then we are done unless ^D{rc{rbx)) = n—1 together 
with {b^rcTbx) < —1. But this is impossible, since 

{b,rcnx) = {b,nx) -2{rbX,c){b,c) 

= — (6, x) — 2 (a, x) (6, c) 

> 1 < 

> -1. 

Thus ^D{rax) = ^D^rbrcTbx) < n in this case too. This completes 
the proof of (i). 

(ii) Replace x by r^x, then apply (i) above. 

□ 

Lemma 3.23. Suppose that x G -D„. with n > 1. Then there exists 
some y G Dn_i with y x. 

Proof. Suppose that the contrary is true. Let x G such that there 
is no root in Dn-i preceding x. Write x = wa, where a G IT, and 
w G S{x). Let w = Ta^Va^ ' ' ''^ai for some ai, ■ ■ ■ , a; G 11 with l{w) = I. 
Then a = r^^ ■ ■ ■ r^^x. Observe that then 

a -< rai_^ ■ ■ ■ Ta^X -< ra,_2 ■ ■ ■ Ta^X -<■■■-< Ta^X -< X. (3.15) 

The assumption that x is not preceded by any root in Dn-i, together 
with Proposition 13. 141 yield that all the roots in (13.151) . including a, are 
in Dn, contradicting the fact the a G 11 C Dq. 
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□ 

Next we give an algorithm to systematically compute all the D^s 
for an arbitrary Coxeter group W of finite rank: 

Proposition 3.24. Suppose that W is a Coxeter group of finite rank. 
For n > 1, there is an algorithm to compute Dn provided that -D„_i is 
known. 

Proof. We outline such an algorithm: 

1) Set D = 0. 

2) Enumerate all the elements of -D„_i in some order, that is, write 
Dn-i = {xi, ■ ■ ■ , where m = #£>„_!. 

3) Starting with Xi, apply all the reflections where a G 11, to 
Xi, one at a time. If (a,xi) < —1, then add TaXi to D if it is 
not already in D. 

4) Repeat 3) to 0:2, ■ ■ ■ , Xm- 

5) Enumerate all the elements of the modified set D in some order, 
that is, write D = {x[,X2, ■ ■ ■ , x'^c}- 

6) Starting with x[, apply all the reflections where a G 11, to 
x'l, one at a time. If {a,x[) G (—1,0) and r^x^ ^ D, then add 
TaX'i to D. 

7) Repeat 6) to X2, ■ ■ ■ , x'^u- 

8) Repeat steps 5) to 7) above. 

9) Repeat 8) until no new elements can be added to D. 
10) Set Dn = D. 

Next we show that the above algorithm will be able to produce all 
elements of Dn within a finite number of iterations. 

Let X G Dn (n > 1) be arbitrary. Lemma 13.231 yields that there 
exists a. y E -D„-i with y -< x. Write x = wy for some w E W with 
i{w) = dp(x) — dp{y). Let w = ra^ra2 ■ ■ -fai where ai, . . . , a; G 11 and 
^{w) = I. Then 

y -< raiy -< rai_Jaiy -<■■■-< Ta^Ta^ " " " Ta;?/ = X. 

Since x G Dn and y G -Dn-i, it follows from Lemma [3.131 that 

raiy, rai^^ra^y, . . . , ra^Va^ ■ --ra^y G Dn-l W Dn- 
Therefore there exists i G {1,2,...,/} such that 

y e -D„_i 

ra^y e Dn-l 

and 
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I ai_i ' ai V Oi+i ' ai. 



■ --raiy) e A 
■■■raiv) e A 



n 



n 



Since ra-^^ra-^j ' ' '^aiU 

it follows that ra^ra^^^rai.^2 ' ' ' '^aiU is 
an element of obtainable by going through steps 3) and 4) above. 
This in turn implies that ra^_j^ra^ ■ ■ -raiV is an element obtainable by 
going through steps 5) to 7). It then follows that ra._2ra._jra. ■ ■ - ra^y 
and so on are all obtainable by (repeated) application of step 8). In 
particular, x = r^^ ■ ■ -ra^y can be obtained after [i — 2) iterations of 
step 8). Thus x can be obtained by going through steps 1) to 8), with 
step 8) repeated finitely many times. Since x G Dn was arbitrary, 
it follows that every element of Dn can be obtained from the above 
algorithm in this manner with step 8) repeated finitely many times. 

Finally, W is of finite rank, so #-0^ < oo and #Z)„_i < oo. There- 
fore step 9) will only be repeated a finite number of times and hence 
the algorithm will terminate completing the proof. □ 

Corollary 3.25. //#-R < oo, then we may compute Dn, for all n G N. 

Proof. ^ gives a complete description of Dq when jj^R < oo. Now 
combine [Ij and Proposition I3.24[ the result follows immediately. □ 
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